Sound Cross-synthesis and Morphing Using Dictionary-based Methods

Dictionary-based methods (DBMs) provide rich possibilities for new sound transformations; as the analysis dual to granular synthesis, audio signals are decomposed into ‘atoms’, allowing interesting manipulations. We present various approaches to audio signal cross-synthesis and crossanalysis via atomic decomposition using scale-time-frequency dictionaries. DBMs naturally provide high-level descriptions of a signal and its content, which can allow for greater control over what is modified and how. Through these models, we can make one signal decomposition influence that of another to create cross-synthesized sounds. We present several examples of these techniques both theoretically and practically, and present on-going and further work.